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A me-bliod and a device for computer-abased procossxng 
a 'ken^late mxnutia se-b a£ a fi.ng-erprizi'b and 
a compu'ber readable s-boracfe medJLtua 

5 BACKGROUND OF THE INVENTION 

The invention relates to a method and a device for computer- 
based processing a template minutia set of a fingerprint and 
a computer readable storage medium. 

10 

In order to provide an identification mechanism based on 
biometric characteristics of a person which is to be 
identified, one biometric characteristic often used for 
personal verification/identification is the person's 
15 fingerprint* 

In this kind of verification/identification, typically the 
person's fingerprint is detected by a fingerprint sensor, 
thereby generating a fingerprint image . 

20 

The word "fingerprint" is herein used as a representative of 
a fingerprint or a like pattern or figure. More 
particularly, the fingerprint may be an actual finger> a palm 
print, a toe print, a soleprint, a squamous pattern, and a 
25 streaked pattern composed of streaks. The fingerprint may 
also be a diagram drawn by a skilled person to represent a 
faint fingerprint remain which is, for example, left at the 
scene of a crime. 

30 Usually, the person, who would like to use a device for this 
kind of verification/identification is required to register 
his or her fingerprint in a registration step for later 
verification/identification in a verification/identification 
step. 

35 

During the registration, characteristic features of the 
fingerprint will be extracted and stored in a storage media 



wo 02/091285 PCT/S GO 1/00087 



of the device. Such a fingerprint: image is called the 
template fingerprint and such a stored characteristic 
features are called the template minutiae. 

5 When a person wants to use the device, he has to present his 
fingerprint to the device. 

The unknown fingerprint of the person who wants to be 
identified in a verification/identification step is usually 

10 called input fingerprint- The characteristic features of the 
input fingerprint will be extracted and matched against the 
template minutiae of the template fingerprint. If a match is 
found, the person is identified as the person the respective 
pre-stored template fingerprint refers to. Otherwise, the 

15 person is identified as an unauthorized user and the further 
use of the device will be prohibited. 

The template minutiae usually comprise geometrical and other 
useful characteristic information (or features) pertaining to 
20 the local discontinuities (the minutiae) of the fingerprint, 
such as 

• the type of the current minutiae, 

• the location of the current minutiae, 

• the direction of the current minutiae, 

25 • the ridge count between the current, minutiae and its 
neighboring minutiae, 

• the location of the neighboring minutiae, 

• the distance relationship of the current minutiae with 
respect to its neighboring minutiae, and/or 

30 • the angular relationship of the current minutiae with 
respect to its neighboring minutiae. 

In [1], [2] and [3], methods to determine the template 
minutiae are described. The basic concept of these methods 
35 is to determine the minutiae present in a single fingerprint 
image. From these determined minutiae, the required 
parameters are subsequently determined. 
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Furthermore, methods to match the fingerprints or to compare 
whether two fingerprints are similar to each other or not 
using the fingerprint templates^ are described in [4], [5], 
C6] and [7] . 

5 

Noise, contrast deficiency, improper image acquisition, 
geometrical transformation, def oannation and skin elasticity 
will make a captured fingerprint image deviate from the ideal 
fingerprint of the person. The poor quality of the captured 

10 fingerprint image will make a reliable minutia extraction 
very difficult. Spurious minutiae can be produced, valid 
minutiae can be dropped and the minutia type {ending and 
bifurcation) may be exchanged due to the noise and 
interference of the fingerprint image. The problem of 

15 automatic minutia extraction has been thoroughly studied but 
never completely solved. The employment of various image 
enhancement techniques can only partly solve the problem [8] - 
In [2] five different minutia extraction techniques well 
known in the literature were implemented and their 

20 performances were compared. in the experiments disclosed in 
[2]/ the best technique* dropped 4.51% genuine minutiae, 
produced 8-52% spurious minutiae and caused 13.03% minutiae 
exchanged their type. The total error is then 26.07%. For 
the rest four approaches, the total error is 33,83%, 119.80%, 

25 207.52% and 216,79%, respectively. From these experimental 
results it is seen that a perfect minutia extraction is a 
very difficult task. 

An automatic fingerprint verification/identification system 
30 will successively receive fingerprint images of users in the 
practical application after the registration- The 
fingerprint imaging condition, which causes the minutia 
extraction error, will change with time due to the change of 
the skin condition, climate and on-site environment- Thus, 
35 the image noises and interferences of fingerprints received 
by the system at different time might be quite different- 
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Howeverr improving the fingerprint image quality based on 
these multiple images is very difficult and memory and 
computation too expensive due to the image size and image 
pose transformation. 



5 



SUMMARY OF THE INVENTION 



ThuS/ it is an objective of the invent ion, to overcome at 
10 least one of the above mentioned shortcomings • 

This objective can be achieved with a method and a device 
that uses computer (s) to process a template minutia set of a 
fingerprint or a computer readable storage medixom, according 
15 to the features described in the independent claims.. 

In the method that uses computer (s) to process a template 
minutia set of a fingerprint, a template minutia set 
comprising template minutiae and a template interest region 

20 is provided. Furthermore^ an input minutia set according to 
an input fingerprint comprising input minutiae and an input 
interest region is provided- The input minutia set is 
matched with the template minutia set. Thereby, matching 
template/input minutiae and non-matching template/input 

25 minutiae are determined. Finally, an updated template 
minutia set is determined dependent on the matching 
template/input minutiae and the non-matching template/input 
minutiae, and dependent on whether the template minutiae are 
inside the input interest region or outside of it and whether 

30 the input minutiae are inside the template interest region or 
outside of it. 

Matching in this context means, that 1) there is determined 
the siiailarity between the template minutia set and the input 
35 minutia set or the template minutia set and the input minutia 
set are known originated from a same finger and 2) the 
template/input minutiae are classified as matching 
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tempi ate /input minutiae or non-matching template/input 
minutiae according to a predetermined matching threshold. 

A computer-based device for processing a template minutia set 
5 of a fingerprint comprises a processing unit, which is 
arranged to execute the following steps: The template 
minutia set comprising template minutiae, a template interest 
region/ and a certainty value for each template minutia is 
provided. An input minutia set according to an input 

10 fingerprint comprising input minutiae, an input interest 
region, and a certainty value for each input minutia is 
provided. The input minutia set is matched with the template 
minutia set. Thereby, matching template /input minutiae and 
non-matching template /input minutiae are determined. A 

15 transformation function using the matching result is 

determined, wherein the transformation function describes the 
relation between the template minutiae and the input 
m:inutiae. An updated template minutia set is determined by: 
adding non^matching input minutiae inside the template 

20 interest region to the updated template minutia set if the 
input minutia set and the template minutia set are known 
originated from a same finger or their matching result is 
higher than a matching threshold; increasing the certainty 
values of matching template minutiae; decreasing the 

25 certainty values of non-matching template minutiae that are 
inside the input interest region; deleting template minutiae 
from the updated template minutia set if their certainty 
values are below a certainty threshold; and using the 
template minutiae, whose certainty values are larger than the 

30 certainty threshold, for the future matching. Finally, the 
above mentioned steps are repeated iteratively for all input 
minutia sets of a plurality of input minutia sets, wherein 
the updated template minutia set is used as the template 
minutia set of the next iteration, and wherein the next input 

35 minutia set is used as the input minutia set of the next 
iteration. 
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A computer readable storage medlixm has a program recorded 
thereon^ where the program makes the computer execute a 
procedure comprising the following steps for processing ^ 
template minutia set of a fingerprint: The template minutia 
5 set comprising template minutiae, a template interest region, 
and a certainty value for each template minutia is provided. 
An input minutia set according to an input fingerprint 
comprising input minutiae, an input interest region, and a 
certainty value for each input minutia is provided. The 

10 input minutia set is matched with the template minutia set. 
Thereby, matching template/input minutiae and non-matching 
template/ input minutiae are determined. A transformation 
function using the matching result is determined, wherein the 
transformation function describes the relation between the 

15 template minutiae and the input minutiae. An updated 

template minutia set is determined by: adding non-matching 
input minutiae inside the template interest region zo the 
updated template minutia set if the input minutia set and the 
template minutia set are known originated from a same finger 

20 or their matching result is higher than a matching threshold; 
increasing the certainty values of matching template 
minutiae; decreasing the certainty values of non-matching 
template minutiae that are inside the input interest region; 
deleting template minutiae from the updated template minutia 

25 set if their certainty values are below a certainty 

threshold; - and using the template minutiae, whose certainty 
values are larger than the certainty threshold, for the 
future matching. Finally, the above mentioned steps are 
repeated iteratively for all input minutia sets of a 

30 plurality of input minutia sets, wherein the updated template 
minutia set is used as the template minutia set of the next 
iteration, and wherein the next input minutia set is used as 
the input minutia set of the next iteration. 

35 The above described method and device for computer-based 
processing a template minutia set of a fingerprint enable 
processing the template minutia set not only during the 
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fingerprint registration process but also during each 
fingerprint verification/identification process.. Thereby/ 
the stored template minutia set is continuously updated and 
verification/identification of a person becomes more and more 
5 reliable / because the template minutia set will be based on 
multiple input fingerprint Images. A processing of the 
template minutia set is also necessary due to different 
fingerprint imaging conditions- The invention enables the 
template minutia set to become more and more independent of 

10 disturbances such as noise and interference, of changes of 
the skin condition and of the climate and on-site 
environment. Thus, the image noises and interferences of 
fingerprints received by the system at different points of 
time produce less difficulties with increasing number of 

15 input fingerprint images. 

According to one embodiment of the invention, the method 
further comprises: determining a plurality of input minutia 
sets comprising a certainty value for each input minutia, and 
20 determining the updated template minutia set by generating 
updated template minutiae from all input minutia sets with 
their corresponding weights - 

Therefore, the detection of spurious minutiae and the non- 
25 detection of genuine minutiae can more easily be limited. 

For instance, a minutia missing in the template minutia- set 
but present in a first, second, „. input minutia set has a 
higher probability that this minutia is a genuine minutia; a 
minutia present in the template minutia set but missing in a 
30 first, second, ... input minutia set has a higher probability 
that this minutia is a spurious minutia. Thus, certainty 
values stored together with the template minutiae enable the 
detection and elim±nation of spurious minutiae and the 
recovery of dropped minutiae. 



35 



•The plurality of input minutia sets preferably comprises a 
time series of input minutia sets. Then, the certainty value 
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could for inscance be a function of time of the corresponding 
input minutia set. 

According to a preferred embodiment of the invention, the 
5 template minutia set will be updated if the template minutia 
set and the input minutia set are known originated from a 
same finger or if the matching result of the corresponding 
input minutiae is higher than a matching threshold, and the 
determination of the updated template minutia set comprises: 

10 1) adding non-matching input minutiae inside the template 

interest region to the updated template minutia set and put a 
certainty value on them, 2) increasing the certainty values 
of matching template minutiae, 3) decreasing the certainty 
values of non-matching template minutiae which are inside the 

15 input interest region, and 4) deleting template minutiae from 
the updated template minutia set if their certainty values 
are below the matching threshold - 

Each interest region can be described by its boundary and the 
20 boundaries of the interest regions are preferably obtained 
using points located on the respective boundary. According 
to one embodiment of the invention the boundaries of the 
template interest region and of the input interest region 
each define a polygon. Such a polygon can be described by 
25 eight or 16 points. 

Preferably the input minutia set is aligned with respect to 
the template minutia set before the matching process is 
started. Such an alignment is very useful due to the fact 
30 that a user never presents his fingerprint exactly aligned to 
the fingerprint detector. 

The template minutia set is preferably selected from a number 
of reference minutia sets. Then, the starting probability of 
35 the verification/identification process is quite good. Each 
reference minutia set comprises a reference interest region 
and it is preferred to select the reference minutia set with 
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the largest reference interest region as the template minutia 
set. 

According to a preferred embodiment of the invention, the 
5 method further comprises determining of whether an input 
minutia is located inside the template interest region or 
outside of it during the matching process / and determining of 
whether a template minutia is located inside the input 
interest region or outside of it during the matching process. 
10 Such an information is necessary for updating the certainty 
values of the template minutiae. 

The alignment of the input minutia set with respect to the 
template minutia set is preferably performed by a 
15 transformation function, which is given by the following 
formula: 




wherein 



20 



^Xjr ^jj aligned point vectors representing the 

location of an aligned point with j as characterizing 
number of each aligned point, 

[x^,y^] is a reference point of the template minutia 



set/ 




is a point in the input interest region with j? 



25 




30 The above mentioned transformation function enables both a 
rotation as well as a translation of the input interest 
region relative to the template interest region. 
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As already mentioned above, it is preferred to repeat the 
update process of the template minutia set tteratively for 
all input minutia sets of a plurality of input minutia sets. 
Then, the updated template minutia set is used as template 
5 minutia set of the next iteration and the next input minutia 
set is used as the input minutia set of the next iteration. 

The above described method and device for computer-based 
processing a template minutia set of a fingerprint enables an 

10 update of the template minutia parameter and of the template 
minutia certainty value by using a recursive algorithm that 
implements a weighted averaging over all received matched 
fingerprints. The weighted averaging increases the precision 
of minutia parameter, corrects the exchanged minutiae, 

15 recovers dropped minutiae and removes spurious minutiae. 
Furthermore, the proposed scheme has the weights of the 
received fingerprints changed with the time so that older 
fingerprints have less and less contribution to the weighted 
average. In this way, the method gradually weakens the 

20 effect of older skin and imaging conditions and enhances the 
recent ones* By using the common region of two matched 
fingerprints, the template minutiae will not grow to cover 
the whole finger but are kept within the region of the 
initial template fingerprint. The proposed recursive 

25 algorithm minimizes the computation time and memory size 

required by calculating . a weighted average. This makes the 
invention having" no problem to be employed in an on-line 
fingerprint verification/identification system. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 



35 



Figure 1 shows a block diagram of a computer which is used 
to perform the steps of the method according to a 
preferred embodiment of the invention. 
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Figure 2 shows an input fingerprint image comprising an 

input interest region of the fingerprint according 
to a preferred embodiment of the invention. 

5 Figure 3 shows a time series of matched input minutia sets 
according to a preferred embodiment of the 
invention. The minutiae are designated with the 
symbol "x" and "^o". 

10 Figure 4 shows an input interest region of an input 

fingerprint according to a preferred embodiment of 
the invention - 

Figure 5 shows a flow diagram showing the steps of the 
15 method according to a preferred embodiment of the 

invention. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

20 

A preferred embodiment of this invention and modifications 
thereof will now be described with reference to the 
accompanying drawings. 

25 Fi.g.1 shows a computer 100 comprising 

• a central processing unit (CPU) 101, 

• a storage device 102/ 

• a computer bus 103, and 

• an input--/output-interf ace 104. 



30 



The central processing unit 101, the storage device 102' and 
the input-/output-interface 104 are coupled with the computer 
bus 103 for exchanging e'lectrical signals. 



35 



Via the input-/output-interf ace 104 and a first connection 
105, the computer 100 is coupled with a fingertip sensor 106, 
according to this embodiment the FingerTip™ sensor of 
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Infineon, Inc./ with which fingertip images of a fingertip 
107 are taken from a finger 108. Furthermore, via the input- 
/output-interf ace 104 and a second connection 109, the 
computer 100 is coupled with a keyboard 110, and via a third 
5 connection 111, the computer 100 is coupled with a computer 
mouse 112- via the input-Zoutput-interf ace 104 and a fourth 
connection 113, the computer 100 is coupled with a display 



10 After the fingertip sensor 106 has taken the fingerprint 

images, the fingertip images 115 are sent from the fingertip 
sensor 107 to the computer 100, where they are stored in the 
storage device 102. In the storage device 102, there is 
further stored a computer program 117, which makes the 

15 computer 100 execute a method comprising the steps, which 
will further be described in detail. 

For further explanation, it is assumed, that each image 
comprises minutiae of the finger 108, which are extracted 
20 from the images 115, 

As described in [9], a fingerprint image can be segmented 
into the interest region and the background with a 
segmentation algorithm. An interest region can be 

25 represented by a point set s, which contains all x- and y- 

coordinates of points within this interest region. The image 
in the interest region can be considered as an oriented 
texture pattern that contains ridges separated by valleys. 
Ridge endings and ridge bifurcations are minutiae that are 

30 used to match two fingerprints. 

For each minutia, a minutia feature, vector Fj^ 116 (k = 1, 
n) is determined and stored in the storage device 102, The 
minutia feature vector Fj^ 116 comprises the following 
35 features: 



114. 



(1) 
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wherein 

is a first coordinate of the minutia k in a given ' 
right-hand orthogonal coordinate space, 
yjc is a second coordinate of the minutia k in the 
coordinate space, 

• <Pk is a direction (- tt < ip^^ s tt), which is defined as a 
local ridge direction of an associated ridge of the 
minutia k^ 

• t]^ is a minutia type of minutia k out of a given amount 
of minutia types (for example, t^^O for ridge ending and 
t]^=l for bifurcation) . 

The first coordinate xj^, the second coordinate yy^, and the 
direction tpy- are dependent on the position and orientation c 
the finger 108 on the fingertip sonsor 10 6, when the 
fingertip 107 is acquired. These features, i.e. 
characteristics, are not rotation and translation invariant. 

•A minutia set P is a parameter vector set that consists of 
parameter vectors Fj^ 116 (k = 1, n) of all minutiae 
detected from a fingerprint - 

Fig -2 shows an input fingerprint image 201 and an input 
interest region 202 of the input fingerprint image 201. 

As already mentioned above the input fingerprint image 201 
can be considered as an oriented texture pattern that 
contains rXdq^s separated by valleys. Ridge endings and 
ridge bifurcations are minutiae that are used to match two 
fingerprints. 

As the skin and imaging conditions change with time the 
fingerprint image characteristics do change with time. As 
the result, input minutia sets extracted from the input 
fingerprint image 201 captured during a verification/ 
identification process might be quite different from a 
template minutia set. Therefore, input minutia sets can be 
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used to update the template minutia set if they are matched 
or if they are known originated from a same finger. To 
update the template minutia set, all matched input minutia 
sets and their input interest regions need to be stored and a 
arithmetic average over all matched input minutia sets need 
to be calculated for every time of an update of the template 
minutia set. This will produce a large size of the template 
minutia set and long computation time. However, a small size 
of template minutia set and a high speed for verification/ 
identification are often required in the application, 
especially for a stand-alone system. To save the memory size 
and speed up the update process, we need a simplified input 
interest region 202 and a recursive algorithm. 

We use a polygon described with a few points to approximate 
the input interest region 202 of an input fingerprint image 
201. Fig. 4 shows the boundary of an input fingerprint image 
201 and as example the resulting polygon 4 02 for the input 
interest region 401. Two farthest points in the boundary are 
found as shown as points (1) and (5) . The point marked (3) 
has the longest perpendicular distance from the top boundary 
to line (l)'-{5). Similarly, point <7) has the longest 
distance in the bottom segment. Using the same method^ 
points (2), (4), (€) and (8) can be found. In this way, a 
fingerprint boundary is approximated by a polygon that can be 
described by a few points. The size of the fingerprint 
template is thus only slightly increased by adding the 
coordinates of a few points. According to this embodiment, 
eight points are used. It is also possible to use 16 points, 
for instance. 

In a first step (step 501) of the method according to the 
preferred embodiment of the invention, a template minutia set 
is determined by using the method described in [3] {see 
Fig. 5) . 
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In a further step (step 502), for each input fingerprint 
image 201, the respective input minutia set is provided. If 
the input minutia set is to be determined from an input 
fingerprint image 201, the input minutia set is determined by 
5 using the method described in [31 - 



10 



15 



20 



Fingerprint minutia matching is to find a similarity level 

P X 

between two minutia sets T and P , one from the template 
fingerprint image and another from the input fingerprint 
image, respectively. The input fingerprint image usually has 
rotation and translation relative to the template fingerprint 
image. Before performing the matching, the minutiae of the 
input fingerprint image are to be aligned with the template 
fingerprint image, 
reference minutiae 



To be specific, two corresponding 

. p p p - - 



t^)^ e and (x*^, y-^. 



<P # 



The 



can be found by using the method in [4] 

aligned minutia set E^^^^j^j is obtained by translating and 

rotating all input minutiae (k«l, 2, K"'^) with respect 

to the two reference minutiae, according to the following 
formula : 
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Two minutiae, one from the template fingerprint image and 
25 another from- the input fingerprint image are said being 
matched if the difference of their aligned parameter is 
within a threshold. Based on the matched and non-matched 
minutiae, a matching score that describes the similarity of 
the two minutia sets is calculated 14] . An input fingerprint 
30 is said being matched with a template fingerprint if their 
matching score ms is greater than a predetermined threshold 
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At the beginning of the methodi according to the preferred 
embodiment of the invention a template niinutia set has to be 
determined. Suppose that there are M sample fingerprint 
images l"^ captured from the same finger and obtained M 

5 minutia sets ^sr^'^jfj^j ^^<^ input interest regions s"*, (m=l, 2, 
M) by applying a minutia extraction algorithm. Then, the 
template minutia set F^^jpj^^O < ir s jFfj is initialized by 

letting F^=F'^ with the interest region S'^=S^ (l^sr^sM) . K is 
the number of the minutiae in F^. The template minutia set 
10 can for instance simply be determined by selecting the 

minutia set with the largest interest region as our initial 
template minutia set F^. 

In the rest M— 1 minutia sets, any minutia set f'^ with m^r can 
15 be picked out as input minutia set. To match it with the 
template minutia set F^ the minutia-matching algorithm 
disclosed in. [4] is applied. 

However, the methods described in [5], [6], or [7] may be 
20 used alternatively as minutia-matching methods. 

In the matching process, an aligned input minutia set 
F^=|f^| is calculated by using equation (2) and an aligned 
input interest region can be calculated- After matching/ 

25 first all unmatched minutiae located outside are 

removed from F^ and the minutia index k in the updated F^ 
is rearranged so that the matched minutia has the same index 
as Its partner minutia in and the unmatched minutiae have 
indexes k=K+l, K+2, .... 



Now, the template minutia set is updated by putting all 
unmatched minutiae Fy^ into F^, i,e. 



pF U |fj^ \ k > k\=^ IP^ 



(3) 
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Correspondingly, the number of the minutiae K in the updated 
template minutia set is also updated. 

Using this updated template minutia set the above process is 
applied one by one to all other M-2 minutia sets. In this 
way M-1 aligned minutia sets and interest reg*ions 

with 1«^M and m^r result- To simplify the formula let 
F^=F^ and S^^=S^. Now all minutiae in (lisr^M) are 

located within the interest region Matched minutiae 

have the same index k and unmatched minutiae have different 
index k {l^krsK) . 

A minutia template update is conducted based on the 
assumption that matched minutiae (here have the same index k) 
represent the same minutiae and unmatched minutiae (her.e have 
different index k) represent different minutiae. If there 
exists a Fj^ with Fj^ G but ^ and 

i^^k^^yk^^j ^ S^, this indicates that minutia k (it might be 

genuine or spurious) was successfully extracted from the 
sample image but failed being extracted from sample image 
1^ although its interest region covers the position of 

this minutia. A minutia certainty value is defined as 



c 



^ « 1 and « 0 to represent this case. 



However, if ^x^, ^ , the location of this minutia is 

outside the interest region of sample image l"^. In this 
case, the sample image provides no information about the 
certainty of minutia k so that cj^ is not defined. For 

simplifying the expression, two index sets are defined for 
each minutia k as following: 

I>k - \n\ ^ F^}, (4) 
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Obviously/ D]^ consists of indexes of minutia sets that 
contain minutia k and Rj^ consists of indexes of interest 
regions that cover the position of minutia k- This means 

DjtGRjt. The minutia certainty value cj^ is then given by: 



^k 



Am 



1/ if m e D;^ 

0, if in ^ Dj^ A in e Rjij- . (6) 

undefined, if m ^ Rjt 



Now let P^«|fj^/ denote the estimated updated minutia set 
where is the certainty value of the estimated minutia 



10 F,^ 



k • 

The estimated- minutiae are conducted by: 



15 c 



^t^cj^c^. (8) 



where wfj^ and wc^ are the weights of and cj^ 

respectively • 

20 Using equation (7) and (8) an updated minutia set is 

estimated from a number of minutia sets extracted from sample 
fingerprints of the same finger. The estimated minutia 
parameter is the weighted arithmetic average over all matched 
minutiae and therefore has better accuracy. As a result, the 

25 exchanged minutiae type {ending or bifurcation) can be 
corrected. 



30 



For authenticating a future input fingerprint^ only the 
minutiae whose certainty value are greater than a threshold 
Cv are used- 
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This means that minutiae with certainty value lower than the 
threshold Cv are regarded as spurious minutiae- The 
employment of the minutia certainty value makes it possible 
that the dropped minutiae in some sample fingerprints can be 
recovered in the estimated minutia set if they are extracted 
from some other sample fingerprints and spurious minutiae in 
some sample fingerprints can be removed from the estimated 
minutia set if they are absent from some other sample 
fingerprints . 

For example^ if we choose equal weights, the estimated 
minutia and its certainty value can be simply 

calculated by: 



where is the number of fingerprints from which minutia k 
is extracted and N]^ is the number of fingerprints whose 
interest region covers the position of minutia k. It is 
straightforward to see that the estimated minutia certainty 
value represents the occurrence frequency of a minutia over 
all sample fingerprints whose interest region covers the 
position of this minutia. Therefore, the estimated minutia 
certainty value can be used to recover the dropped minutiae 
and remove the spurious minutiae . 

F±g.3 shows a template minutia set 300, a first input minutia 
set 301 and an second minutia set 302. The minutia sets 300, 
301 and 302 comprise first minutiae 304, which are designated 
with the symbol "o" in Fig. 3, and second minutiae 305, which 
are. designated with the symbol "x" in Fig. 3. The first 
minutiae 304 designate endings of ridges (tk«0) and the 
second minutiae 305 designate bifurcations of ridges (tk=l) . 
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To enable the matching process, the input minutia sets 301 
and 302 have to be aligned with the template rainutia set 300 
as already described above. 

The three minutia sets 300, 301 and 302 show the minutiae 



different times . Alternatively, the three fingerprint Images 
can be matched based on a minutiae matching process. The 
first fingerprint image taken at a first time is used to 
determine the template minutia set 300. At a later point of 
time relative to the first fingerprint image the second 
fingerprint image is taken. As can clearly be seen, the 
first input minutia set 301 taken from the second fingerprint 
image should be aligned to the template minutia set 300. 
Further, the first input minutia set 301 comprises less 
minutiae than the template minutia set 300. Therefore, the 
template minutia set 300 is updated with respect to the 
minutia positions, directions, types as well as with 
certainty values cj^ for all minutiae . 

Finally, the third fingerprint image represented by the 
second input minutia set 302 is taken- The second input 
minutia set 302 has to be aligned with respect to the 
template minutia set 300* Thereafter, the second input 
minutia set 302 comprises further minutiae, which are already 
not incorporated in the template minutia set 300- Therefore, 
the template minutia set 300 is again updated. 

In Fig -4 an input interest region 4 01 of an input fingerprint 
is shown. The input interest region 401 is the boundary of 
the input fingerprint, which is described by a polygon 402 
comprising eight points (1)...{8)- 

I.et {^^'y^\ denote the coordinates of the eight points 



representing the template interest region and [x::.,y:^] denote 



extracted from three fingerprint images. The three 
fingerprint images are taken from the same finger at 
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the coordinates of the eight points (1)...{8) representing the 
input interest region 401 with j=l, 2, 8. The aligned 

input interest region presented by ^x^, j| is obtained by: 



W • (-' 



cos(Ap) 
sin(A9>) cos(a?>)J 



(11) 



10 



p p IT 

Where fx ^ y ) and (x ^ y ) are the corresponding points of 
the template minutia set and of the input minutia set, 
respectively, which are obtained by. the minutia matching 
process. 



15 



A point (X, y) of a template minutia is within the input 
interest region 401 if and only if; 

AjX + Bjy + C J- < 0 (j « 1, 2, . . - , S), 



(12) 



3 - yj -yj^i' Bj 



where A 
with (x#,y9^) ^ (^f.yf)- 



26 Similarly, it can be determined whether a point (x, y) of 

aligned input minutia is within the template interest region 
by using equation (12) with Aj = - yj'+i.Bj - xj^^ - xj 

and Cj = -Ajx-^ - Bjy| . 



25 In the practical application of a fingerprint verification/ 
identification system, input minutia sets are compared with 
template minutia sets. if an input minutia set is 
successfully matched with a template minutia set, it is 
verified or identified that these two minutia sets originate 

■30 - from the same finger. 
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Suppose the system received M aligned input minutia sets 

Cj^j successfully matched with a template minutia set 

"j^/C^|. The updated template minutia set fjif / c^j is 

calculated by equation (7) and (8) with the template minutia 
5 set and M matched input minutia sets. Usually the finger 
skin and imaging condition changes with time. Thus, In 
equations (7) and (8) the latter received input fingerprints 
should have higher weight than the earlier ones. In 
addition/ the template fingerprint is usually captured with 
10 great caution during the registration whereas the input 

fingerprints might be captured with less caution during the 
verification/identification process. Therefore, a higher 
weight is assigned to the original template fingerprint than 
to the input fingerprints . 

15 

Without losing the generality, equation (8) can be rewritten 
as : 

cf-^jfcf+A 20^c^. (13) 

20 

with the condition: 

25 where fi^ is the weight for template minutiae and Xfij^ is the 
weight for input minutiae. X with 0<X<1 is used to 
distinguish the weight of template minutiae from the weights 
of input minutiae. Since input fingerprints are sequentially 
received by the system, cj^ with m G Rj^ can be represented 



30 in a sequence c^in) with l^n^Njc- With c^(nj^) representing 

4 



the newest input and c1?(l) the oldest, the equation (13) can 



be rewritten into: 
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« fii^kHio) + A ^ fii^h^i^k - (15) 



P 



where c^(N]^) represents the updated minutia certainty value 
by one original template and Nj^ input fingerprint entries. 
5 Since the original template c^(o) is even older than c^(l)/ 

/?(n) (0<j8(n) </J(n-l) ) weight the minutiae of different coming 
time. 

By choosing a power series as the weights fi(n)^o?^, (0<a<l) , 
10 the condition (14) can be expressed in a closed form 

a^ir + A l: a" « a^^ + A ^ " " ■ 1 . (16) 

By choosing >L«l-a^ the condition (16) will hold true 
-15 independent on the value of a and the number of the element 
Nj^ in the sum operator. Thus, the same value of a can be 
used for different number of fingerprint entries U^, i.e, 

^^i^k) = a^^cj(0) + a - «) 5; a^cJ(Arjt - n), (17) 

n«0 

20 

and 

c^{N]c + 1) « a^^"*"^c^(0) + (1 - a) 2 + 1 - n). (18) 

n=0 

25 From equations (17) and (18) results 

cf(Wjt + 1) = ac^{N}^) + a - ct)c^{Njc + 1). (19) 



30 



Equation (19) is the recursive template minutia certainty 
value update formula, where c^i^k) is the old template 
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minutia certainty value and c^{Nj^ + l) is the new template 
ininutia certainty value after the system receives a new entry 
c^iNj, + l). 

5 In a similar way^' a recursive template minutia parameter 
update formula can be obtained from equation (7) as 

^k i^k + l) * ccF^iNjc) + (1 - a)F^{Njc + 1), (20) 

10 where F^{njc) is the old template minutia and F^(njc + l) is 
the new template minutia after the system receives a new 
entry F^^Nj^ + l). 

Since a fingerprint verification/identification system 
15 usually has nonzero false acceptance rate^ falsely accepted 
or falsely identified input fingerprints will produce 
negative effect for the template update. Therefore a larger 
matching score threshold with T3>Tv is used to determine 
if an input fingerprint is to be used to update the template. 
20 Furthermore, the shortest time interval T± between two 

successive updates of a template could be limited to prevent 
the purposely-repeated abuse of the template update. In this 
vjayr the negative effect of on-line fingerprint template 
self -updating procedure can be diminished - 

25 

With respect to Fig, 5 the proposed fingerprint template self- 
updating algorithm is described. 

In the first step 501, users enroll in the fingerprint 
30 verification/identification system, A minutia set of 

each template fingerprint is extracted by using the method 
described in [3] . For multiple enrollments of the same 
finger, equations (9) and (10) can be used to generate an 
updated template. 



35 
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Eight or 16 points j^-'^j ' ^^)} determined to represent the 

interest region of each template minutia set by using the 
method described in this application- All minutia certainty 
values Cj^ of all template minutia sets are initially 

5 assigned to be 1 for single enrollment or, alternatively^ are 
calculated by equation (10) for multiple enrollments. The 
current time t^ is read and the update time t^ of each 
template minutia set by tu=tc is initialized. 

10 In the second step 502^ the system is waiting until an input 
fingerprint is received. 

If an input fingerprint is received, the third step 503 is 
executed. An input minutia set F*^ "^ifjt} input 
15 fingerprint is extracted by using the method described in 
[3], 

In step 504, the input minutia set is one by one matched 
with P^=|Ff 1 ^Fjf e j A ^c^ cv^l of each template 

20 minutia set to get the largest matching score ms and the 

corresponding aligned input minutia set P^=]p]^j by using the 
method described in [4] . 

In step 505 it is determined whether the largest matching 
25 score ms is lower than or equal to a predetermined threshold 
Tv If this is true^ put out a rejection information and go 
Ipack to step 502. Otherwise output the best-matched template 
ID, 

30 The current time t^ and the last update time t^^^ of the best- 
matched template minutia set are read- As already mentioned 

. ._:„.. above, a larger matching score threshold Ta with. T-a>Tv is 
used to determine if an input fingerprint is to be used to 
update the template minutia set. Furthermore^ the shortest 

35 time interval between two successive updates of. a template 
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minutia set could be limited to prevent the purposely- 
repeated abuse of the updated template minutia set. In this 
way, the negative effect of on-line fingerprint template 
self-updating procedure can be diminished. In step 50 6 it is 
determined whether the matching score ms is lower than or 
equal to the larger matching score threshold Tq or whether 
(t^-tu) is lower than or equal to the shortest time interval 
Ti. If this is true, go back to step 502. Otherwise let 
tu«tc and go to step 507 . 

Eight or 16 points j^x^r j| are determined in step 507 to 

represent the input interest region by using the method 
described above. 

15 An aligned interest region ^^)} input 

fingerprint is obtained using equation (11) . 

In step 508, the best matched template minutia set ^^j^]^} 
will be updated as follows, wherein a template minutia and an 
20 input minutia have the same index k if and only if they are 
matched; 

• For all matched template minutiae, the minutia parameter 

and certainty value cj^ are updated by 

aF^ + a - cz)Fj^ =*• F^ and ac^ + a - 0£) =^ c^ - 

25 • Use equation (12) to find all unmatched template minutiae 
that are located within the aligned interest region S of 
the input fingerprint. The certainty values of these 
minutiae are updated by acj^ =^ c^ . 

• The certainty values of other template minutiae are 
30 unchanged c^ =i> c^ . 

• Use equation (12) to obtain ail unmatched input minutiae 
that are located in the template interest region S . 
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Merge these minutiae into the template by and 
- a - oc) - 

In step 509 the template minutia set is further updated by 
5 removing template minutiae whose certainty values are lower 
than a threshold ct (cx <l-a) . The updated template minutia 
set is saved and the process goes back to step 502. The step 
509 iis aimed at limiting the enlargement of the template 
size. This can be regarded as letting c^=P/ if Cj^<cx. 

10 

The above described on-line fingerprint template processing 
scheme updates the template minutia parameter and updates the 
template minutia certainty value by using a recursive 
algorithm that implements a weighted averaging over all 
15 received matched fingerprints. The weighted averaging 

increases the precision of minutia parameter (xj^, y^, cp]^) , 
corrects the exchanged minutiae tj^, recovers the dropped 
minutiae (from c^<Cv to c^&Cv) and removes the spurious 

P p 

minutiae (from cJ^a^Cv to .c^<Cv)- Furthermore, the proposed 

20 scheme has the weights of the received fingerprints changed 
with the time so that the older fingerprints have less and 
less contribution to the weighted average. In this way, the 
system gradually weakens the effect of the older skin and 
imaging conditions and enhances the recent ones. By using 

25 the common region of two matched fingerprints, the template 

minutiae will not grow to cover the whole finger but are kept 
within the region of the initial template fingerprint- The 
proposed recursive algorithm minimizes the * computation time 
and memory size required by calculating a weighted average. 

30 This makes the proposed approach suitable to be employed in 
an on-line fingerprint verification/identification system. 
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mhat Is claimed. ±s: 

1. A method for computer-based processing a template minutia 
set of a fingerprint^ comprising the following steps: 
5 a) providing the template minutia set comprising template 

minutiae and a template interest region, 
b) providing an input minutia set according to an input 

fingerprint comprising input minutiae and an input 

interest region, 

10 c) matching the input minutia set with the template minutia 
set, thereby determining matching template/input minutiae 
and non-matching template/input minutiae, and 
d) determining an updated template minutia set dependent on 
the matching tempi ate /input minutiae and the non-matching 

15 template/input minutiae, and dependent on whether the 

template minutiae are inside the input interest region or 
outside of it and whether the input minutiae are inside 
the template interest region or outside of it. 

2 0 2. The method according to claim 1, 

wherein the method further comprises the following steps; 

• determining a plurality of input minutia sets comprising 
a certainty value for each input minutia, and 

• determining the updated template minutia set by 

25 generating updated template minutiae from all input 

minutia sets with their corresponding weights - 

3. The method according to claim 2, 

wherein the plurality of input minutia sets comprises a time 
30 series of input minutia sets and wherein the certainty value 
is a function of time of the corresponding input minutia set, 

4. The method according to claim 2 or 3, 
wherein step d) comprises: 

.3.5 • sidding non-matching input minutiae inside the template 

interest region to the updated template minutia set if 
the input minutia set and the template minutia set are 
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known originated from a same finger or their matching 
result is higher than a matching threshold, 

• increasing the certainty values of matching template 
minutiae, 

5 • decreasing the certainty values of non~matching template 
minutiae that are inside the input interest region/ 

• deleting template minutiae from the updated template 
minutia set if their certainty values are below a 
certainty threshold, and 

10 • using the template minutiae, whose certainty values are 
larger than the certainty threshold, for the future 
matching. 

5, The method according to one of the claims 1 to 4, 
15 wherein the boundaries of the interest regions are obtained 
using points located on the respective boundary. 

6- The method according to claim 5, 

wherein the boundaries of the template interest region and of 
20 the input interest region each define a polygon- 

7 . The method according to claim 6> 

wherein the polygons are described by eight or 16 points 
each. 

25 

8. The method according to one of the claims 1 to 7, 
wherein between step b) and step c) the input minutia set is 
aligned with respect to the template minutia set. 

30 9. The method according to one of the claims 1 to 8, 

wherein the template minutia set is selected from a number of 
reference minutia sets. 

. 10.. The method according to claim 9, 
35 wherein each reference minutia set comprises a reference 

interest region and wherein the reference minutia set with 
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the largest reference interest region is selected as the 
template minutia set. 

11- The method according to one of the claims 1 to 10, 
wherein step c) further comprises the step of determining of 
whether an input minutia is located inside the template 
interest region or outside of it, and whether a template 
minutia is located inside the input interest region or 
outside of it. 

12. The method according to claim 8, 

wherein aligning the input minutia set with respect to the 
template minutia set is performed by a transformation 
function given by the following formula: 

f^l + ( ^^^(^^^ sin(A^h " 
M ^ \y^] I- sin(A^.) cos(A^)j ' \ yl . yiy 



wherein 



are aligned point vectors representing the 



location of an aligned point with j as characterizing 
number of each aligned point, 

is a reference point of the template minutia 

set/ 



is a point in the input interest region with j 



as characterizing number of each point, 

is a reference point of the input minutia set, 

and 

• is an angle enclosed from i^^^ ' t j • 

13, The method ' according to one of the claims 1 to 12, 
jwherein. steps, b) to d) are iteratively repeat ed_ for all . input 
minutia sets of a plurality of input minutia sets with 

• the updated template minutia set as the template minutia 
set of the next iteration, and 
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• the next Input minutia set as the input minutia set of 
the next iteration, 

14, A computer-based device for processing a template minutia 
5 set of a fingerprint, 

comprising a processing unit, which is arranged to execute 
the following steps: 

a) providing the template minutia set comprising template 
minutiae, a template interest region, and a certainty 

10 value for each template minutia, 

b) providing an input minutia set according to an input 
fingerprint comprising input minutiae/ an input interest 
region/ and a certainty value for each input minutia, 

c) matching the input minutia set with the template minutia 
15 set, thereby determining matching template/input minutiae 

and non-matching template/input minutiae, 

d) determining a transformation function using the matching 
result/ wherein the transformation function describes the 
relation between the template minutiae and the input 

20 minutiae, 

e) determining an updated template minutia set by 

• adding non-matching input minutiae inside the 
template interest region to the updated template 
minutia set if the input minutia set and the template 

25 minutia set are known originated from a same finger 

or their matching result is higher than a matching 
threshold/ 

• increasing the certainty values of matching template 
minutiae, 

30 • decreasing the certainty values of non-matching 

template minutiae that are inside the input interest 
region/ 

• deleting template minutiae from the updated template 
minutia set if their certainty values are below a 

35 certainty threshold/ and 
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• using the template minutiae i» whose certainty values 
are larger than the certainty threshold, for the 
future matching, and 

f) repeating steps b) to e) iteratively for all input 

minutia sets of a plurality of input ininutia sets with 

• the updated template minutia set as the template 
minutia set of the next iteration, and 

• the next Input minutia set as the input minutia set 
of the next iteration. 

15. A computer readable storage medium, having a program 
recorded thereon, where the program makes the computer 
execute a procedure comprising the following steps for 
processing a template minutia set of a fingerprint: 

a) providing the template minutia set comprising template 
minutiae, a template interest region, and a certainty 
value for each template minutia,, 

b) providing an input minutia set according to an input 
fingerprint comprising input minutiae, an input interest 
region, and a certainty value for each input minutia, 

c) matching the input minutia set with the template minutia 
set, thereby determining matching template /input minutiae 
and non-matching template/input minutiae, 

d) determining a transformation function using the matching 
result, wherein the transformation function describes the 
relation between the template minutiae and the input 
minutiae, 

e) determining an updated template minutia set by 

• adding non-matching input minutiae inside the 
template interest region to the updated template 
minutia set if the input minutia set and the template 
minutia set are known originated from a same finger 
or their matching result is higher than a matching 
threshold, 

... • -l-ncreasing the certainty values of matching template 
minutiae. 
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decreasing the certainty values of non-matching 



10 f) 



template minutiae that are inside the input interest 
region^ 

• deleting template minutiae from the updated template 
minutia set if their certainty values are below a 
certainty threshold, and 

• using the template minutiae, whose certainty values 
are larger than the certainty threshold, for the 
future matching, and 

repeating steps b) to e) iteratively for all input 
minutia sets of a plurality of input minutia sets with 

• the updated template minutia set as the template 
minutia set of the next iteration^ and 

• the next input minutia set as the input minutia set 
of the next iteration- 



wo 02/091285 



PCT/SGOl/00087 



FTGl 



1/5 




TftS 



— ^ 



J 



iw lis 



1-3 D. ii-t ll?- 



AtO. 



wo 02/091285 PCT/SGOl/00087 



3/5 



FIG 3 
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FIG 4 
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